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Some recent results concerning the Sherrington-Kirkpatrick model arc reported. For T near 
the critical temperature T c , the replica free energy of the Sherrington-Kirkpatrick model is 
taken as the starting point of an expansion in powers of SQ a b = {Qab ~ Qa^) about the 
Replica Symmetric solution Q?j ■ The expansion is kept up to 4-th order in SQ where a Parisi 
solution Q ab = Q(x) emerges, but only if one remains close enough to T c . 

For T near zero we show how to separate contributions from 1 < T < 1 where the 
Hessian maintains the standard structure of Parisi Replica Symmetry Breaking with bands 
of eigenvalues bounded below by zero modes. For T <C x < 1 the bands collapse and only 
two eigenvalues, a null one and a positive one, are found. In this region the solution stands 
in what can be called a droplct-likc regime. 

1. Introduction 

The Sherrington-Kirkpatrick (SK) model [H, 0], introduced in the middle of 70's 
as a mean-field model for spin glasses, has played and important role besides the 
study of spin glasses. The search for its solution in the low temperature phase, the 
spin glass (SG) phase, has lead to the introduction and development of tools such 
as the Replica Method and the concept of Replica Symmetry Breaking, that have 
found applications in a variety of other fields of the complex-system world, just to 
cite a few, neural networks, combinatorial optimization and glassy physics. 

The signature of the SG state is the presence of a large number of degenerate, 
locally stable states. When the system is driven into the SG phase, the spins almost 
freeze and fluctuate along local fixed directions. Thus, similar to what happens in 
the low temperature phase of a ferromagnet, the thermal average of a single spin 
does not vanishes in the SG phase. Yet, at difference with a ferromagnet, the local 
directions may change from spin to spin without any special rule, that is in a 
random way. Therefore the SG phase is not characterized by a long range ordering. 
Also, since each spin can choose among different local directions, the SG phase is 
actually made by a large number of degenerate locally stable states. If we take a 
shot of one of such SG state, we shall discover that it is not distinguishable from a 
paramagnetic, i.e., disordered state. Thus we can think of the SG phase made by 
a large set of almost frozen paramagnetic (disordered) states. 

Direct consequence of such a scenario is that identical ideal replicas of the sys- 
tem, indistinguishable in the paramagnetic phase, when driven into the SG phase 
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may end up into different SG states and, hence, becoming distinguishable. The 
symmetry among replicas is then broken. 

The solution of the SK model which accounts for this scenario was found at 
the end of the 70's, and it is now know as the "Parisi Solution" 0, 0]. Since then 
many of its properties have been studied and understood. Some questions, however, 
are still open, among them its validity for finite dimensional systems. Despite the 
subtleties, and mathematical ambiguities, of the replica method, see e.g. [H], it 
is now accepted that the Parisi Solution is correct for the mean-field SK model. 
For finite dimensional systems it is less clear and a different scenario, the droplet 
picture, an essentially replica symmetric description, as been put forward. The 
connection between the two is still not fully understood. 

In this paper we shall discuss SK model replica symmetry breaking solutions that 
are obtained by expanding about the replica symmetric solution. The interest for 
these solutions is twofold: from one side one can investigate the set up of the replica 
symmetry breaking in the SG phase. The study of these solutions is also relevant 
for the definition of a field theory description of the SG phase that could be used 
to investigate the crossover from mean-field to the finite dimensional systems. 

In the last part of the paper we shall briefly discuss the solution of the SK model 
in the limit T< 1, where an (almost) replica symmetric description arises. 



2. The SK model and the SK-solution 



The Sherrington-Kirkpatrick (SK) model in absence of external fields is defined by 
the Hamiltonian [l|, |2| 



U 



1 hN 



(1) 



where a = ±1 are Ising spins and the symmetric couplings Jij are i.i.d. quenched 
Gaussian random variables of zero mean and variance equal to 1/N. All pairs of 
spins interacts, and the scaling of the variance ensures a well defined thermo- 
dynamic limit as N — > oo. 

The thermodynamic properties of the model are obtained from the free energy 
(density) —f3Nfj = InZj, where /3 = 1/T is the inverse temperature. In disordered 
systems Zj, and hence fj, is a random quantity. We must therefore average the free 
energy fj over the disorder. To overcome the difficulties of averaging a logarithm, 
the average over the disorder is computed using the so-called replica trick. This 
procedure is essentially the identity 

\Z n ] — 1 

where the square brackets denote disorder average, and / the disorder averaged 
free energy density. For an integer n, Z n may be expressed as Z n = YYa=i ^a, and 
may be interpreted as the partition function of n identical, non-interacting, replicas 
of the real system. Averaging Z n for integer n over disorder introduces an effective 
interaction between replicas. Performing the average, and introducing the auxiliary 
symmetric replica overlap matrix = ^ a ia&ib, with a ^ b, the disordered 
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averaged replica partition function can be written as 



n= fu^ d Q a ^ NC[Q] (3) 

J a<b 



with the effective Lagrangian (density) 



ab 



Q[Q] = lnTr CTa exp ^ Q ab (Taa^J 



(5) 



The last term in (j4]) follows from the definition Q aa = 1. The normalization factor 
in ([3]) gives a sub-leading contributions for N — > oo and is omitted in the following. 

In the thermodynamic limit, N — > oo, the integral over Q a f, in ([3]) is evaluated 
at the stationary point, 

' £[Q] = 0, a < b, (6) 



that leads to the self-consistent equation for Q ab \ 



Tr^aaab exp ( ^- ^T afe Qab 

Qab = 1— {- = (a a a b ), a^b. (7) 

Tr CT exp ^ afe Qafe cr a cr 6 J 

The replica free energy density then reads: 

-n/3f(n)=£[Q], (8) 

and the average free energy / is recovered as the limit n — > of f(n). 

To solve the self-consistent stationary point equation ([7]) an assumption on the 
structure of the overlap matrix Q a \j must be done. As the n replicas of the real 
system are identical, one may reasonably assume that the solution should be sym- 
metric under the exchange of any pair of replicas. Based on this, SK in their original 
work assumed 0] 

Qab = ^ab + Q (1 - ^ab) (9) 

where q is the overlap between any pair of different replicas. This form of Q ab is 
what it is now known as the Replica Symmetric (RS) Ansatz. The physical meaning 
of q is 

«=[Wi) 2 )j (io) 

where (• • • ) denotes here thermal average for fixed disorder. In absence of an ex- 
ternal field the local direction of (<7j) is random, and depends on the disorder 
realization, and hence = 0. Therefore a nonzero q indicates local magnetic 

order, without a long range ordering. 
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Substitution of Ansatz ([9]) into the stationary point equation ([7]), or into eqs. 
(J4j) , (|5j) and ([6]) , leads in the n — > limit to the self-consistent equation 



that, besides the paramagnetic solution q = 0, admits for T < T c = 1 a non-trivial 
q solution. The order parameter q(T) is a decreasing function of temperature, 
that is equal to 1 at T = and vanishes for T —> T~ . An explicit solution of (llip 
may be obtained by expanding near the points T = and T = 1. One then finds 
that q vanishes as T c — T as the critical temperature T c is approached from below, 
while 1 - q(T) ~ T as T -> 0. 

This solution yields, however, an unphysical negative zero temperature entropy 
The analysis of the stability of the stationary point also reveals that the RS 
stationary point becomes unstable as n — > for all temperatures T < T c [6]. 

The failure of the RS Ansatz has a physical origin. Below the critical temperature 
T c the phase space of the SK model breaks down into a large, yet non extensive, 
number of degenerate locally stable states in which the system freezes. The symme- 
try under replica exchange is then spontaneously broken, and the overlap matrix 
becomes a non-trivial function of the replica indexes. Following the parameteri- 
zation introduced by Parisi 0, 0], the overlap matrix Q a b for R steps of replica 
permutation symmetry breaking -called RSB solution- is divided along the diag- 
onal into successive boxes of decreasing size p r , with po = n and pr+i = 1, and 
elements given by: 



with 1 = Qr+\ > Qr > • • • > Q\ > Qo- In this notation r = a n b denotes the 
overlap between the replicas a and b, and means that a and b belong to the same 
box of size p r but to two distinct boxes of size p r +i < p r - 
The solution of the stationary point equation can be obtained for any value of 
The case R = gives trivially back the RS solution. It turns out 
that a physically acceptable solution for the SK model is obtained only by letting 
R — > oo, that is by allowing for an infinite number of possible spontaneous breaking 
of the replica permutation symmetry. The solution is called full replica symmetry 
breaking (FRSB), or infinite-RSB solution (oo-RSB) to stress the limit R — > oo. 
In this limit Q r — Q r -\ — > 0, r = 0, . . . , R, and the matrix Q a f, is described by 
a continuous, non-decreasing function Q(x) parameterized by a variable x. The 
meaning of x may depend on the parameterization used. In the Parisi scheme 
x G [0, 1] and measures the probability for a pair of replicas to have an overlap not 
larger than Q(x) 0]. The FRSB equations can be solved in the full low temperature 
phase (^-[l5|. In Fig. [1] we show the form of Q(x) obtained from the numerical 
solution of the FRSB equation [From Ref. [101]] . 

3. Expansion around the RS solution 

From the analysis of the replica symmetry breaking solution at small finite replica 
number n, Kondor [l6j] has found that below, but close to, the critical temperature 
T c the instability of the RS solution appears at the finite value n = n s (T) < 1. For 
n > n s (T) the free energy f(n) coincides with /sk(^) from the RS solution, while 
for < n < n s (T) it is given by /frsbC^) from the FRSB solution. The crossover 
is rather smooth since fsK^n) and /frsb^)) along with their first two derivatives, 




(11) 



Qab — Qanb=r — Q 



r = 0,--- ,R + 1 



(12) 
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Figure 1. Q(x) as function of x for various temperatures. From bottom to top T = 0.95 to T = 0.30 in 
step of 0.05 [From Ref. [Tc| l. 



coincide at n s (T). To investigate the nature of the replica symmetry breaking in 
the low temperature phase one can then expand Q ab around the RS solution. 
One then considers an overlap matrix Q ab of the form, see eq. (|9|), 



Qab = Qlf + Qab = 6 ab + q(l- 5 ab ) + 



(13) 



where q is given by the SK Replica Symmetric solution (|TTj) and q a b is the deviation 
from the Replica Symmetric solution. Inserting this form of Q ab into (j4j), and 
expanding the functional Q[Q] in powers of q ab , yields: 



n /3f = -n/3/sK - %-q V q a b ~ V q 2 ab 



ab 



ab 



+ E^(y) fc ((E^^) fc ) +°(- 2 ) ( 14 ) 

where the subscript "c" indicates that only connected contributions must be con- 
sidered, i.e., only the terms that cannot be written as the product of two or more 
independent sums. All others give contributions of 0(n 2 ), or higher. The first con- 
tribution, /sk, is the SK free energy 



/3 2 2 /3 2 



PfsK = ~Y q + lncosh (/ ?z ) + ln2 + °( n ) 



(15) 



where the overbar denotes the average over the Gaussian variable z: 



dz 



e- z2/2q g(z). 



(16) 
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Whit this notation the RS solution (llip takes the compact form 

q = 9 2 , 9 = tanh((3z). (17) 

Expanding the cumulants in eq. (fl~4"l) up to order 0(q^ b ) included, the lowest 
term needed to break replica symmetry, one obtains [ItJ 



n(3f = -n/3/sK + 



where 



4T 4 



6(2T 2 ) S 



+ 



24(2T 2 ) 4 



abc ab 

P ^2 lacqcdQdb + Q^2 ^dlbd^cd + R ^2 q ^ Qcb 
abed abed abc 

QacQcbQba 

ab abc 

A 22 Qaeqbeqceqde + B ^ qac^ld^db (18) 
abede abed 

~B 22 QacqdcQceqeb + C ^ qacQc^Qba ~C ^ qacqadQdcQcb 
abede abc abed 

+AD ^2 <tL<lcb ~3 D Y1 QablbcQbd + E ^2 qabqbcQcdqde 



abc 



abed 



abede 



-2E ^ QabQbcqld + F ^2 labqbcqcdQda + G ^ lab ~ H ^2 ^c<?cft 
abed 

+0(n 2 ) 



abed 



ab 



abc 



M = 20 2 (1 — 2 ), N = (I — 9 2 ) 2 — T . 



(19) 



P = 24fl 2 (l-0 2 ) 2 , Q = -16# 4 (1 -6 2 ), R = -A8 9 2 (l-9 2 ) 2 , (20) 



J = 16 9 2 (l-9 2 ) 2 , K = 8(l-9 2 y 



(21) 



A = 32# 4 (1 - 39 2 )(l-9 2 ), B = 384# 4 (1 -8 2 ) 2 , C = 384# 2 (1 - 9 2 ) 3 , (22) 



D = 64 6> 2 (l-30 2 )(l-0 2 ) 2 , E = 192 9 2 (l — 9 2 ) 2 , F = 48(l-# 2 ) 4 , (23) 



G = 32(l-30 2 ) 2 (l-fl 2 ) 2 , H = 96(l-30 2 )(l-0 2 ) 3 . (24) 

The equation for q ab follows from the stationarity condition (d/dq a b)f = ap- 
plied to the replica free energy functional (|18p . In the limit R — > oo this becomes 
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Figure 2. Q(x) versus x at temperature T = 0.9. The horizontal dashed line shows the SK solution 
Q(x) = q. For this temperature we have x c = 0.168846 . . ., Q(x c ) = 0.109238 . . . Q(0) = 0.013570 . . . and 
9 = 0.102701.... 



an integro-differential equation for q(x), whose solution is 



x 



X 



+ A 



a — bSi, < x < x c , 



(25) 



and q(x) = q(x c ) for x c < x < 1. The parameters a, b, s and A are functions of 
the coefficients of the expansion (|18p . and hence of T, while T, S\ and x c must be 
determined selfconsistently. For details we refer to Ref. [T^ |. It turns out that below 
the temperature T = 0.549 ... no physical solution with q(x) 7^ is exists and only 
the SK solution Q(x) = q survives. Figure [2] shows the solution Q(x) = q + q(x) 
for T = 0.9. 

Near the critical temperature T c = 1 the solution can be expanded in powers of 
t = T c — T <ti 1. The first terms of the expansion of q(x) for < x < x c read 



l(x) 



V4 + 6x 2 
1 



+ 



4^/2 



+ 



3x(2 + x 2 



+ 



3(2 + 3x 3 ) 5 /2 L 



(2 + 3x 2 ) 3 /2 ^/2(2 + 3x 2 ) 3 /2_ 
64\/2 - 236\/2x + 312\/2x 2 - 138\/22; 3 - 8lV2x 5 



56\/2 + 3x 2 - 168x 2 ^2 + 3x 2 - I26x 4 \/2 + 3x 2 



+0(r 3 



(26) 



while for the breaking point x c one has 



(27) 
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From these expressions, and the expansion of the RS solution q close to T c , follows 

. . , . 56 o 220 a 3968 ^ fi , . 

Q(0) = q + ^(0) = — r 3 - — r 4 + — r 5 + 0(r 6 ) (28) 



Q(x c ) = q + q(x c ) =r + T 2 -T 3 + ^r 4 - ^r 5 + 0(r 6 ). (29) 

A peculiarity of this FRSB solution is that Q(x) does not vanishes at x = 0, as Fig. 
[2]clearly shows. 0(x = 0) only vanishes at T c , and grows as (T c — T) 3 , see eq. (|28j) . 
below it. The reason for such a behaviour is that the FRSB "opens" around the RS 
solution Q RS (x) = q. As the temperature decreases the RS solution q grows from 
zero and drags Q(x = 0) to finite values. At T = 0.618 . . . the value of Q(x = 0) 
eventually overcomes that of q. 

In the absence of external fields that break the up/down symmetry Q(x = 0) 
must vanish. The finite value of Q(x = 0) then indicates that more terms in the 
expansion (j!4h must be retained in order to balance the drag from q. Alternatively 
a null value of Q(x = 0) can be recovered by taking q = 0, which eliminates 
the drag from the beginning. Physically this means by performing the expansion 
around the paramagnetic solution. In this case, however, the FRSB solution exists 
in a narrower region, 0.9148 . . . < T < 1, close to the critical temperature. 

We note that the choice q = was used to derive the so called Truncated Model 
largely used to study the low temperature phase of the SK model. This model 
is based on an expansion that retains only the main mathematical structure of the 
expansion of the replicated free energy in powers of Q a b near T c , where \Q a b\ "C 1, 
but, similar to the Landau Lagrangian, with arbitrary coefficients. The mapping 
between the expansion (118f) with q = and the Truncated Model is F = H = 0, 
N = 2T 3 (1 — r), K = 8T 5 w and G = 32T u with arbitrary u and w. In this case, 
if w and u are temperature independent, the FRSB solution exists only down to 

Item = 1 - W 2 /4u. 



4. Solution near T — 



In the previous Section we have seen that the RS solution can be taken as a starting 
point for a development of the FRSB solution for T c — T<^. 1. As the temperature 
becomes significantly lower than T c the expansion looses physical meaning and 
more and more terms are needed into the expansion to extend its validity. Due to 
the particular structure of the expansion, in powers of /3, it is likely that an infinite 
subset of terms should be considered to tackle with very low temperatures. 

Surprisingly a Replica Symmetric description appears at T — > 0. Indeed as the 
temperature is lowered towards T = the probability that Q a b < q c (T) = 0(1) re- 
mains finite, viz. x c ~ 0.524 . . . as T — > jl0l.ll9l| . At the same time the probability 
of finding overlaps Q a b significantly smaller than q c {T) = 0(1) vanishes with T. 
Then, since Q(x = 0) = 0, for T< 1 the order parameter function Q(x) undergoes 
an abrupt and rapid change of 0(1) in a tiny boundary layer of thickness 5 ~ T 
close to x = 0, while it is slowly varying for 5 -C x < x c , as depicted in Fig. [3j 
In the limit T — > the thickness 6 ~ T — > 0, and the order parameter function 
becomes discontinuous at x = 0. 

Uniform approximate solutions valid for T « 1 can be constructed by study- 
ing the problem separately inside (inner region) and outside (outer region) the 
boundary layer. 
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Figure 3. Shape of Q(x) as function of x for T <§C 1. The shaded ares shows the extent of the layer of 
thickness <5 ~ T where the larger variation of Q(x) is concentrated. 



The inner solution for Q(x) was first computed by Sommers and Dupont M , and 
recently extensively studied by Oppermann, Sherrington and Schmidt [13h15||. It 
turns out that as T — > the inner solution Q(a) remains a smooth function the 
inner variable a = x/T, needed to blow up the inner region, varying between ; for 
a = 0, and q c (T) ~ 1, for a > 1. The outer solution was studied by Pankov [12j |. 
who found that in the outer region one has 



Q(x) ~ 1 - c((3xY 



T <C x <C x c and T 







(30) 



where c = 0.4108 ... and i c ~ x c (T = 0) = 0.524 .... 

This behaviour of Q(x) has strong consequences on other relevant quantities and, 
also, on the structure of the eigenvalue spectrum of the Hessian of the fluctuations 
governing the stability of the stationary point. For what concerns the stability one 
finds (3, HO] that in the region x < 5 ~ T, where Q(x) varies rapidly from up 
to q c ~ 1, the spectrum of the Hessian of the fluctuations maintains the complex 
structure of the FRSB solution found close to T c (2l|. That is a Replicon band 
whose lowest eigenvalues are zero modes, and a Longitudinal- Anomalous band of 
positive masses. 

In the region T <C x < x c , the eigenvalue spectrum has a completely different 
aspect. The bands observed in the FRSB regime collapse and only two distinct 
eigenvalues are found: a null one and a positive one 20J]. This ensures that the 
FRSB solution remains stable down to zero temperature. We note that zero modes 
arise from the Replicon geometry, with Ward-Takahashi identities protecting them 
221 ] , and arises also from the Longitudinal- Anomalous geometry, without protection 
of the Ward-Takahashi identities. It is worth to observe that the stability analysis 
of the RS solution also leads to two eigenvalues, one of which is zero to the lowest 
order in T c — T (and negative to higher order) and a positive one 0] . 

From the expression (|30p it follows that the variation of Q(x) in the outer region, 
T <C x < x c , is [Q{x c ) — Q(x)]/Q(x) ~ c(T/x) 2 , rather weak for T — > 0. Thus in 
this region, that covers the overwhelming part of the interval < x < 1 for T — > 0, 
we have a marginally stable (almost) Replica Symmetric solution, that become 
a genuine Replica Symmetric solution for T — > 0, with self- averaging trivially 
restored. 
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5. Discussion 

In this paper we have reported some recent results on the solution of the SK model. 
In particular we have considered two different issues. In the first part we discussed 
the analysis of the Replica Symmetry Breaking done through an expansion around 
the Replica Symmetric solution. In the second part we examined the properties of 
the solution in the limit of vanishing temperature. 

The expansion of the replica free energy functional around the RS solution, 
truncated to the fourth order in q a b = Q a t> — Q^, , leads to a FRSB solution with 
a continuous order parameter Q(x) below the critical temperature T c = 1. The 
solution, however, exists only in the range 0.549 ... <T< T c . Moreover the value 
of Q(x = 0) is finite and vanishes only for T — > T~ with the third power of the 
temperature difference. A null Q(x = 0) can be recovered by expanding about the 
(replica symmetric) paramagnetic solution q = 0. In this case, however, the FRSB 
solution exists only close to T c = 1, in the narrower interval 0.915 ... < T < T c = 1. 

For what concerns the stability we believe that the solution form the expan- 
sion around the paramagnetic solution q = has the same stability properties in 
the most dangerous sector, i.e., in the Replicon subspace by virtue of the Ward- 
Takahashi identities [22], of the Truncated Model. We believe that this feature re- 
mains true for the expansion around the SK solution as well [23[ • Thus the FRSB, 
where it does exist, is marginally stable with null Replicon eigenvalues. 

Finite RSB solutions, or even RS solution q^ = q (1 — J^), may also exists. These 
may exists for all temperatures below T c , or only in a limited range of temperature. 
In either case all these solutions are unstable, with negative Replicon eigenvalues. 

The main limitation of the expansions discussed here is the limited range of 
temperatures where the FRSB solution exists. To extend the range one should 
retain more terms in the expansion. This will also cure the finite value of Q(x = 0). 
Due to the particular structure of the expansion, in powers of f3, it is likely that an 
infinite subset of terms should be considered to extend the validity of the expansion 
to very low temperatures. If one is interested into these temperatures different 



approaches, e.g., that proposed in Ref. 24] based upon an expansion around a 



spherical approximation that leads instead to an expansion in T, may be more 
suitable. 

The striking property of the solution of the SK model for T <C 1 is the presence 
of two well distinct regions where the order parameter function Q(x) behaves dif- 
ferently. In the first region, close to x = 0, Q(x) varies rapidly from Q(x = 0) = 
to Q(x) ~ q c = 0(1) for x ~ T. In this region, that contains (almost) the whole 
variation of Q(x), the solution maintains the structure of the FRSB solution found 
for higher temperature and close to T c , including the complex Hessian spectrum, 
even in the limit T — > 0. For this reason this region was called the RSB-like regime. 

In the second region, for T <C x < x c ~= 0.575 . . ., Q(x) is a very slow varying 
function of x, the variation being indeed of the order [Q(x c ) — Q(x)]/Q(x) = 
0((T/x) 2 ). Here the bands observed in Hessian spectrum for the RSB regime 
disappear, and only two distinct eigenvalues are found: a null one and a positive 
one, ensuring the stability of the FRSB solution down to T — > 0. In this region, 
that covers the overwhelming part of the interval < x < 1 for T<1, the solution 
strongly resembles a stable RS solution typical of a droplet description. For this 
reason this region was called droplet-like regime. 

In the limit T — > the domain of the RSB-like regime shrinks to zero, and 
only the droplet-like part of the solution remains. It is then tempting to interpret 
this as a zero temperature transition/crossover from a FRSB solution to a droplet 
scenario. We stress, however, that while these results strongly suggest a transition 
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or crossover between RSB and droplet descriptions in spin glasses, to have a better 
understanding of the behavior of finite dimensional systems loop corrections to 
the mean- field propagators must be considered [25l |. Work in this direction is in 
progress. 
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